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ABSTRACT 



PROBLEM TO BE SOLVED: To make it possible to display pictures matched with 
various requests for observing the whole picture or observing details of 
the picture in details on a touch display device for presenting a picture 
of a graphical user interface to a visually handicapped person. 

SOLUTION: An operator specifies the area and center position of a display 
region of a graphical user interface to be displayed on a touch panel 30 by 
the use of a display region area setting part 11 and a display region 
position setting part 12. A display region calculation part 106 finds out 
the existing range of the display region in accordance with the 
specification, an information acquiring part 104 finds out an arrangement 
state to be required at the time of displaying interactive parts existing 
in the display region on the touch panel 30 based on the existing range of 
the display region and the number of pins existing on the panel 30, a pin 
state data generation part 105 generates pin state data indicating the 
states of respective pins existing on the panel 30 based on the arrangement 
states of the interactive parts, and a touch panel control part 20 drives 
the pins on the panel 30 in accordance with the pin state data. 
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30 (D&mco^Bmx'fo*) . m^mmv>*£&n<W£7F£'? 
vxKb'cojmmtmw.x'ff o t wt'* & . m 2 con^ 

mt^Biifli 1 *>»aiw>H»fc it® ut . xnj&m 

[0039] iS^^fiSiS^SP 1 2 SfLtH*f- 

^x^ns 1 ocof^t) 0 z&mwstmum 1 2 ^^r 
sat4o^iajn**Lfcjs» -r-^«ia^ai oo<Dft4? 

Ofcr-^WWKl 0 0a*«iatjS. GJHKfel 0 
40 0 R coftb 0 (cGMiKMc 1 0 0 R a L 
Htc. f-^«Sl»Bl OOafcXr-V/UHft 

S£MSP1 0 7jWUnS*ufejS. ^-A^JlSffi^l 0 20 
«*> 0 t^-A*8aiffl 10 2a fcfflifcjSi. ^S^^ 
tfffffi 1 0 6 C7)ffcb 0 IC^gi^H^:^ 1 0 6 a 
fcjS&&««3ffiLT^&. jiSS. ^-AAiaaaiJl 0 2aH 
r * j *-iWT$*uti}. IS^^^H-^SP I06at 
r * j *-#f¥T£*t*:<I k £ii»rrSISi(g2:W'rs *> 
»T» S . ^SlSt^gl? 1 0 6 a k l&^lii^- 

^351 0 6 k^)ffi3t(i. a^l^tfmgS 1 0 

50 a^M^>t"CMffi£^cV)-5o^L. m^mmm 



(8 

1 3 

m i 1 m-ft^im-Mttzm lx v>& . 

[0040] f-^JGJlSBE 1 0 0 atfMt-T^&tm 

mmtbx'h *) . f-rwmim iooa imrn^ a * 
y°uj mmwfflwmt Lxm^-^^tmbcoyu^y^ 

z-rvy^Mt. f-fWmgiWi o o ati^ti^ 

ID^ix. x-*JM£a 1 0 0 a<7)iM££i6Wf 6 £ t 10 
X\ f-^)®IgilOOa±t:. ^f-A^^gUl 0 
2 a, WBE£*E&«SP 1 0 3 , fif*8ffitf#gB 1 O 4 . 
ttSSf-^^JSS* 10 5, 106a, ft 

- vivmmm& 107 zmm?& . 

[0041] *HS6^©«0^S{±. ^^^v^x 

*t-v/i'<mM$:*'bk-fz,imm£t *c&&x'foh . 

Ill (a)ll 07 (a) fcHtWSttflTC*** 5 . 
f££T*{4. £ ( X 1 , Y 1 ) Z*»bt-t2>ffim2 0 4 . 

a warn 205 tmtmmx'h swi, 

{±. V^^-V;P2 0 3*^Di:-rS^2 0 7, * 20 
fcii^&2 0 8#3l^&&::&roT^6 0 fij$n&3 0<0 

2 0 7#^fH$tf)i§£) (iiai 1 ( b ) tc^-r-r — 

[0042] *mmv>MM<D#-< yhx'$>&$kvm®cr> 
*>bmmz^?zmnw&imT<?>m*)X'$>z>. 
mtf&mmm£S4 o lt . v?x#-y/p£ia 

11(a) ^S*^ia 12(a) ntfLm&T&mZit 
tzt-th. ZCDB%^ OS10lK7^X^-yA-2 0 30 

6* 

[0043] jfr-yjusmeffisii 0 7(4. OS 1 0 1 
i> i $m-t&ikX<?)4^>h$:miLX}5*). ±j£(?>W 

y/p 203 etBmmtf&ft Ltz z t ^y 
h^mm-ttt mi3, s 1 3 ij^yes) , tru* 

V>X*-V;P2 O 3<DJ^gffi£OS 1 0 1 A^Btff L 
T^M^mgP 10 6 a£*U£>-££ ( S 1 3 2 , SI 
33) . 

[0044] m*kffimmtft l O 6 a{4. #-VA<&S 40 
ITtggP 1 0 7*^iiSJ$^)tif Uv?T?X#-yA^M 

gm£U3T L . fi?a8R#g|5 1 0 4 tcfis**- * . i £ X\ 

09tf$&mmz%*). wmm®\ 0 4i4. 04o«i 
ftiafc^uts&sfcufiru 08 (a) «o ± 3 
<r)^f-<9**m-h. trnztitzmwizKLxvyim 



ttHW 1 1-16 1 .1 5 2 
1 4 

2 0 £51^.1 tX. M*U&3 0 {413 1 2 ( b ) ICtk"^ 

[oo45]c:«oj;3 %mmz-$-& z t x\ mrnzmt 
xmm Ltcifity . $t?vtcttMi$AUzn lx mmzwip 
zhnt &zt &xz h t ^ o ** hh . 

[0046] ft(c*|&i«<0»3»5afcWJBSBtot^a 
[0047] *HS6^jg®-c{4. ^atftO«ffcC»3&*«a 

-ywfmmz$ttzti. *ti£UMmit£titt&Bt& 
cD^mm^tih. mi 4izm3<r>m&<vm&<vmtfL 

iz. imm^mzm^Mco#>bfm<?)mmzm^ti 
m^^mmmfm^-i-ya - y ? mxh m 1 4 

«3 0 k . ftfe*nas3 owy£Mfrt&Mtinmiiffl%t 
20 Tny^mimzs: *)mm-&T-?mm£m 

1 0 0 b t „ fEU&tt lOORbi. J^*g^g4 0 
k. Wfg&iS1fLT^<ieit^S5 0*^fi|j£$<x-5. 
[0048] 121^^5 0(4. 1 t 

*tj£«j!ij!ei§sis5 2(4. fflsaHfcfca^-r-^ 

[0049] T-^3!tta^a lOObll «^RWA^> 

mnmm*Mtt&mmmto 1 0 4 1 . f!4*ns?j^ 

S5 1 0 5 k , tm%*3 onm^^^th&mififo&J 

^yv*mi!rt-&4'<*yhmmf.i o&t. 

*m** ttmmM><o^mzj:^xw£zmK)tti-rznm 
guifn^sgp 1 0 9 1 . itijjT-fmim notH 
tr. m^-^mmi 1 o«4. w&mmm$5 2z 
#m lt , mm®<o *&t,z?f$i-tmmt$&commt,z 

[0050] x-^*5^ai 0 0 bj&He£TV**f2» 
fftlOORbJl fa;. 4HSfMty, ^-coffico 

fEiww^a 0 , -r- ^jjaa^ia 1 0 0 b ^sjt^x^ x 

3&*IE«S*tT V>* . lB^«E«c 1 0 0 R b IZtmZtlX V> 
S7n^7Alt -r-^MflSatl OObfcioTft* 

x-^«taJISl 0 0b±lc. ffiBRffffl 04, 

e^^anf -^^naw 105, -i^y hmmu 1 0 s . 

*fMSUiSrPaEg|? 10 9, 1 1 0 $r|^S 

[0051 ]^. 2tc||{6<0^®T{4. ^^t^^S{4 
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1 5 

[00 5 2] [21 5fcM^>-M£ffi8&l 0 8Oj«yi#!l£ 

j^-rasta. n eattiss&ifMEifti 0 9«ji!ui«ai£- 

10 

[0 0 5 3] 121 8 (a) (4. /57-()>;l'- JL-lF • 
^fy^7x-xictj(f-i.^rn^^ 1 000 

-0fC**. £<TT\ &«s##v?x#-y;U2 0 3£r 
SI 18 (a) ^^TftS^Bj . ^\>h 

IHggfl 10 8J1 O S 1 0 1 #mtt& 81* %J <y h 

(015, S15 1#YES, SI 52). 

[0054] znwmz&v&k. m&m&msmi o 

9(4. OS1 0 1 tWLT^^^-V^2 0 3c7)T r 20 

^rav^*>**i fc tci O^xtf— y/P2 0 3»T« 
tf<®£t8d£r& (01 6. S 1 6 1 ) . OS10U1 

(Z^^&*f»iH^M^»»iH«ffi 1 0 9 (Z» 

ftrfS. -7>>x^-y/P2 0 3i7)Tt:WiSa{ n a n^ 

=fci^arv*»£*4. -c-o^fi-jtmsnnmai 1 0 9tcii*n 

[00 55] 01 8 (a) «<f:3(C. ~? 1 7X#—V)\s2 
0 30T(dWS*toJWtttf-r, O S 1 0 1 30 

LSr VvT fc tfimZ *ufc*£J4 . tSfgJRftSB 1 
QA*mf\fr$- (S162#NO, S163).jaift. 
*1 . m2O*Sfe<7)0ffl^<ffii:N^iiaB|*^<l 
B0*>. 1ffgJR#a510 4-C^M^F ( JW*f^g|5iSiO 

mim 2 0 VyW&T- ?JKf#gfl 10 5 T«£*L 

f $■ SWS&»&3 o (r> t y . 

•tOfgmt LT. fc&*n©3 0(4. 018 ( b ) «RBfc 
=5:&. 40 
[00 56] 01 8 (a) ^)«SS*»^, f£feg#V<7X 
ij~V)V1 0 3 019 ( a ) 

?^HSff5 1{=(4. 02 1 (a) . (b)fciSWSlO 

*»&aJM!Htffi5 2 (Cli. ^A^S15iai:02 1(a). 
(D7-?bWttfcL. #fiyMtm2 1 (b) cox- 

[0057] v^x^-yn^ o 3<38tt0f « -f 

^hsssui osKio&ajsfu h«H3KUv?? 50 



WHH* 1 I -16 1152 
1 6 

x*-y^2o 3<7>mmw^&BiB&E»i 0 9 *cai 

*n$ttl> (015. S 1 5 1 *'*YE S . S 1 5 2 ) . 
[0058] ZtllZl *) . .1. 0 9*4. -7 

7^2 0 3<7)TO^!S?:iS<S (016, SI 
6 1) . 019 ( a ) T'(4. 7-)X/;-y/U2 0 3##t 
fSgB.ft2 1 10>±(=ffiKL*^4fctf>. fl»BIR«aflO 

4-d4«r<aj*Tr-^«as»i 1 o u v>x 
o 3<?)TfcX^A^a{ n a n2 1 1 aq?q3E-r-s.r 

fc£jl*tr3~& ( S 1 6 2A J YES, S 1 64 ) . 

[0059] ftjjT-ftfm® 1 1 0(4. Masmsmm 
$$5 2<7mmzmiLT . ^Aa9Mwz*fjw-*H2 

1 (a) O'T-^fcflMj^-^WfS&S lj&»fe5l*ffiL 
T. «!*nfli$ljffllg52 0 fciW (017, S 1 7 1 . SI 
72) . 

[0060] ite»^iJ«IgP2 0(4. «S*Ufe'r-^fc:« 

0(4. 019 (b) WRBfcsfr*. 

[006 1 ] SE£. 7W-V^2 0 3Ji2 0 

(a) <?>tm (#^vaHfc2 1 2 0Ji) 
•&(;rl4. ajTJx-^tfcSisSffl 1 O#02 1(b) ayf- 
^Sr?|g=ajLT<^7t^ (01 7, S171, SI 7 
2) . ttS3 0H 02 0 (b) wKfflt44. 

[ 0 0 6 2 ] r«J: 3 arfiMttt* i tX\ 

S^ti(4'M*0^«®*^#<^i>-S.5ti6. -9--fX^>/Jx 

[0063] »:fc^HH»*4«safc<>D}E»Bfc:o^T» 

[0064] 44ltt^>«nt4. -t-f Xtf5/h$3fir«|SaHfc 

•a.— If • -f >"^7x-X<55BM (fiQBiSlB) SrrtgP'C^ 
flRU i6»ag(3(4. Hi<0/57 a *>V ■ • -4 > 

?7x.-X<mm (HBOB) T'(453:<iS«lBESr^-r 

IS4OSISfe^®O«|^<!f!lSr*i-02 2(4. fB2. 3<^) 
h. H2 2tcJ:&fc. *HM^RItt. tr^^ri^-f^ 

%m®mm> 2ot. v^x^r ff^^fg^is4 o t . 

ro^AfflWcJ: Oi6^-Sr-^3?^^Sl 00c 
S5 0ckA^fiK$nS. 

[0065] fEi^l^ 5 0 c (4. ^iBBB^MfflffiffgSrie 
1gLT*5< MEtSf8ie<SS55 3 i: . Wmmt:!i&tZ> 

fc*fxoflHiifce« t-c *j < <RSM®^firfgiB«gp 5 4 
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MMfSfSiElias 5 5 b . 
[0 0 6 6] 4fc s -r-^MHBBttl OOcIl 
4i])V- jl— -f y^7x— ^^filifcOS 1 0 1 

SP5 3i*i«liHtS^^srrr^HWtffSlR^l l l 

teMi-^isaiBiiii^isffii i 2fc. -?*7 *it-v turn 
m*mk-$h-ti- yi^m i o 7 1 . nugg^s 

[0067]^. BflBffiffW4. £Hiif&£fcfc<K&rai: 
fc«W*«ISBRBiOfiHE^:#3. ^^7y3 ^ (if 

[oo 68 j mi?>\m!mffimm\ i i?)8yifl!Sr 
^•t-sstfua. m2 4i±{mmm$Lf&.mi 1 2 
ijrrss*ua. S2 sitmsmfamammi i 3*>«bi 
M^simit<fe | ). jar. wmzmmtx. 
<mm<^^b^x^himmm^^mm^mm 

[0069] ti&RgBjtt£j£3*i&*)U:. Hffiffl(c:MA> 

<T>mt H26(a) (Zifrt*/ 4 V K>?2 2 0« 
fct^tftSilfck^. H26(a)-(c)t8 
Wt, 2 21i±'>^yK'>«# < 2 2 2(i.-K^>gPo a p. 
2 2 3fiM b^A'- 2 2 4J4^ — a — . 2 25 
-2 2 9(17^3^, 2 3 0{±^5-fT>'h^. 2 3 

[0070] fflB£ft££8g|f 1 0 2(4. OSlOl*^ 
/y 3 y («I3S»iBiJc*»3Wi."CV^7^) Srfc'Ogtt 

tins* ttisiuziisasaHGfi ^rBXf# l ( m 2 3 , s 2 3 
1 ) , mmmmvms 3izmxrt& < s 2 3 2 > . a 

ffitPSJBtfS&l l tiQBHiB£i£tt l l 2tdHfll* 
(#^4#ffc(c£j£$*t*:'7 ^H7221 OftM 

[0071] 1 1 214, wrnmmvm 



1 0 ) tm¥ 1 1 - 1 6 .1. .15 2 

1 8 

4 . S 2 4 1 , S 2 4 2 ) . (BBBLiBiBfO^duM^OHM 

t4, laT^ao-c**. 

[0072]jfef, ^9>fT>'h«W2 3 0l*l<0T>f3 
y2 2 5~2 2 9<e*l/flitC*rU W0-&"3>flS«ifti: 

Sittmutrnx-comffiiz. mmmrnmrn sb5 3 teg 

^Izm^Z Z b if-X £ -5 . 7-f3y2 2 5-2 2 9(0 
10 ^fc**LT±Iitf>*ffl£ilr$-fc . H2 6 ( b ) 0>A * 

[0 0 73] sK*V2 2 2fc£f?5>fT>'MRt* 

xt3&Tf®s&t&>&. ztit>i±. mmmtmmmiz 

^bim-tt Z. ZbiPC**. M27 

20 < a ) (css-tEwa^* b . tmsett. 

Object. X=Object. XO+Objec 
t. dX 

Object. Y=Object. YO+Objec 
t. dY 

Ob j e c t . W=Ob j e c t . WO+Ob j e c 
t. dW 

Object. H=Object. HO+Objec 
t. dH 

k«ST-* 6 . &m.<T>Q> bjec tOflMHittflgff 

30 3,<nmmzmmt&t$ftx\ ^^^220 

(4. Wi ndow. *7 J y\ i WW2 2 1cr>Wr£liFr 
ame. ^y2220^fiButton, 94 hfr 
A-2 2 3C9^£-(4TB. ^-x«-A«-2 24WIWtt 
MBt . Mi (4*. > 2 2 2 ^BatWI 

(@(4. Button. wofc^Ei-*ifcfc:5Sr&. i 

fc. fmmm^mmMm^ 5 4 02 7 < b > « 
<t o ZBXxmmtfmmztix v ^ . 

[0074] fiflfetC. ^ T> hffik&2 3 OcoWyft 

m&m { !fck.ztifi:ft. 7?4T>him2 3 o&m 

tf-ff{4iir^T'*&. S^W^fli^HBO'f^-v 
(4. 02 6 ( c ) tc^rfc^fc^S. 
50 [0075] M*nas3 0±^<?)ffif8a*(4. ®2 
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w^kWA o imftztixm^mmmit Lfc«^fc«. 

V /U9ib£8& 10 7 LT&SiHSHMm 
1 30Waj3*l.4. <Sii!BEBiffifEBX^n 1 3T 
(3. OS101 -m=5r< . <KMf3tW#i21&$5 5 

(a) tm®<DmmT-?z>m$-& (025, S2 

5 1, S2 5 2) . uWf-^ll ey«®x-^^£J« 
S$l 0 5£&£*l& (S2 5 3) . 10 

1 0 0 7 6 ] ^cnf—riztt lx vyimf-fZL&B 
1 0 5 x-m-mmzm-z tizx*). nm^^n^x- 

s^jffligP2 0{±. zcot~? ^ms z »mm 3 0 j^o t 

[00 77] 

ogewdtfiBT-ss. " 20 

[ 0 0 7 8 ] Ig2 «*«^+^«ISffliBW>±fc: 
[0079]*3fc. -fr-f X^hS**HS*ift*WC 

[ 0 0 8 0 ] ^4 ^ffl«Ofiiffi«fg^S:-7^X^: 30 
ifOSWSSiEBTfr -5 J: 5 fcrr* £ t X\ MSrZ'Z fc 
WISSHWc** U W«fc»ff fcfln£ & .r & . 

[013 4^^»l«^<o«Wlofl|«Wt^yn 

[H2] 0 2^Wa«fc*rtatfLH"C 

25 ■& . 

[03 3 Siii36ftiSEffittl 0 3*>*^fcijrtSaiiai"C 

. 

[04 3 mmmnm 104 nwmz^-rffitimTh 40 

[05 3 e^ttn-r-^^jsai 0 5conmm^~rm. 
tmx'foz. 

[06 ] a^«9Ktm:»i 0 e^mmm^-tm^imx- 

„ 

[07] 4ijtv jl— -y- >fy^7x-wiH 

[ 08 ] umimff 104 t'£j£$*is -f-* k . ey 

«*S^f«fc«aTft*. 50 
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[09] ^sa^asjWLfcfc&oBiffs-aKHi- 

*£*>«>IS'C&&. 

[01 0] ^E^»2fl3SI^JBflS<0«iK«&^-7' 

[01 l ] /77-/*A" Jt-—f • -f>?-;i-x«I 
M k M*tl3£ 3 0 <F> tr >co«t@ t ink-tmx'h 6 . 
[012] «551^t3ESeUfcfc*«aw^*Bl"!W-*/i 

[013] #-y/i*»lWBfflWi 0 7«o»ffl«fcjS-fS 

*10-C&3«. 

[0143 ^wmmsnmmnw&nmmitK-t? 

[01 5 3 -^^vMISai O8«S!MMS:^-rsSar0 

[0163 ttfSSKiPniMIS 1 0 9 £7)»raWI^S'r»ax0 

[017 3 Si:frr-**afflH 1 OfltfBBWfcScfH&h. 
0T£>6. 

[018 3 v>^*-y/I'2 0 3A««KaiWfc±fc#ftL 
[01 93 V^*-y/k2 0 3jWWIS»ft2 l'l±fc 

fiRtf- & fc # wmfe*wgfthiz.*#mcib & . 

[02 0 3 y;l/2 0 3tfHfiaUfc2 1 2±t 

[02 1 1 as:fr?-*«»»5 lfcWBSftfc^-**) 

[0223 *%HJ!^40||i5fe^®o«|^M^^r 
n-y^0-e*.S>„ 

[02 3 3 mmmmnmi 1 l^waw^jjcrsaia 
[0243 fltura^j&gfl 1 1 2 mmm* ^-twxm 

[02 5 3 fl^«a®fS«ffi#S51 1 3<^*!Sffl£^-rs£ 

[02 6 3 HBffi, {SSBSmM *-SS&prfBFC3!, 
«. 

[02 7 3 {^HcB^ffifRsaigaJtlBli^aTUST 

[02 81 fla*»BO»J««tjirfrt7v^lia' , C 1 *>*. 
[«P^«I^H83 

10. 10a-x-^A*iSB 

i i-m^mmmm^m 

3 0— Mttffi 

3 l-ty 

4 0— Mgfg^lS 

5 0, 5 0c, 5 0d-RffiRK 
5 l-£ii7JT-^#«a5 

5 2-«*5fflaiJie«gs 
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